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OPTIMUM QUANTIZATIONS 


Abstract 

//JO? 

The transformation required by the quantization process of a continuous 
variable results in an error that may be considered as noise. We define 
Optimum Quantization as the type that minimizes the mean square (or peak) 
error for a constant number of quanta. This optimization is possible when 
the probability density function of the continuous variable is known. 

Relations involving the quantization intervals as a function of the 
probability density function and the number of quanta are developed for 
three cases, i.e., when the mean of a quantum represents the values of the 
variable in that interval after quantization, when the midpoint assumes 
the above representation and when the probability density function is 
approximated by a piecewise uniform probability density function with 
discontinuities at end points of the intervals. In the last case, the mean 
and the midpoint for each interval coincide. 

Interesting results are obtained for the special case when the 
continuous variable has a uniform probability density function; optimization 
of this case results in uniform quantization which incidentally produces 
the maximum mean square quantization error. 



I. INTRODUCTION 


The majority of telemetry systems is concerned with the measurement and 
transmission of information about the value of a finite range continuous 
variable. 

A typical telemetry system such as the one shown in Figure 1 exposes 
some of the most important transformations that the variable. is usually 
subjected to, from the point of measurement (or source) to the recording 
station (or receiver). 

At the receiver, the detected value of the variable may be ia .error 
due to errors, or equivalently noise, introduced by the transformation, and 
the medium. . , . . 

There are always errors in the received value of the variable whenever 
this variable goes through an irreversible transformation.* For example, 
referring to the building blocks of Figure 1, sampling is not an ^irreversible 
transformation if the sampling rate is more than or equal to 1/2W where W 
is the highest signal frequency, or in some cases the bandwidth. However, 
quantization and addition of noise are irreversible transformations . 
resulting in errors. 

Although the statistics of the errors due to individual disturbances 
can be easily found, in case of more than one disturbance, these disturbances 
must he properly combined. The two most serious disturbances ret erred to 
here are the error due to quantization and the channe l noise . 


*An irreversible transformation is defined here as a transformation T which, 
if applied to x, will result in xT and whose inverse cannot restore x by 
the operation (xT)T~l, or if T lias no inverse. 
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To provide the necessary background for this discussion, the second 
part of this paper is devoted to the definitions and the types of 
quantization errors and their strong correspondence to the choice of the 
point that represents the infinite number of points of a quantum. This 
part ends with a proof that for uniform quantization the error is independent 
of the probability density function of 

Part IJlI is devoted to an introduction of information measure, and 
the information loss due to quantization and gaussian noise. This part 
is concluded with a comparison of the errors due to channel noise and those 
due to quantization yith a brief description of their dependence on n, 
the number of levels. In addition, the two disturbances are combined for an 
optimum choice of n, the number of quantization levels. 

Part IV utilizes the probability density function of a random variable 
x to optimize the quantization process by minimizing the quantization error, 
under three different conditions. 

Finally, Part V is devoted to discussion and some results obtained by 
using typical probability density functions as examples. 

II . DEFINITIONS OF QUANT IZATION E RRORS 

Quantization is a many-to-one transformation of a set of values of a 
continuous variable into one value . This transformation maps an infinite 
number of elements, representing the values of a continuous variable in a 
certain range r^, to one element that corresponds to the range r^. 

Before proceeding any further, we must identify this element that 
corresponds to r^ in such a manner so as to enable ourselves to define a 
measure on the quantization error. 
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Since r^, being an abstract set of points, cannot be represented by 
one value, two alternate values that could be used in lieu of r^ are the 
mean of x in the interval r^ and the midpoint of this interval. 

The mean value of x in the interval (x^^, Xj_) is expressed by: 

r x i 

I xp(x)dx 
J xi_i 


m i = 


/. 


x i 


p(x)dx 


c i-l 


( 1 ) 


In this case, the average error is: 


< e> “ J (x-ra^ p (x) dx =0 


( 2 ) 


The midpoint of the interval (x^_^ , x^) is defined as: 


[ i-l 


+ X i 


(3) 


In this case, the mean error is not generally equal to zero. However, the 
peak error becomes ±q^/2 where q^ is the ith quantization interval; 


qi = x i - x i-i 

The significance of these two types of characterizations of r i will 
become evident by referring to Figure 2a where the random variable, x, has 
been uniformly quantized into six intervals x Q , Xj_, , x & . If the range 
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of x, r^, is identified with the bottom of each interval the error 

is plotted in Figure 2b and varies from zero to q^. 

Let us now draw a set of lines of value v^ on the error curve (Figure 2b) 
and call them the zero error lines for each interval. This procedure is 
equivalent to identifying the ranges r^ by x^_^ + v^; the error in this 
case will vary from -v^ to q^ - v^. 

The peak error is either |" v i| or ^i " v i whichever is larger. By 
letting 

| _v i| ■ - v i or v i = 

we minimize the peak error. Thus by setting v^ equal to the midpoint we 
minimize the peak error. 

Similarly, the mean square error is 



(x- v t ) 2 = x 2 


2x Vi + 


V 


2 

i 


To find the value of for minimum square error, we differentiate the above 

expression with respect to and set it equal to zero. 



<e 2 > 


-2x +2v i =0 or v 1 =5T*m i 


So the mean square error is minimum when the r.v.x is identified with the 
mean of the ith quantum. 
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In summarizing, we have described here two methods of identifying the 
quantized variable x in the ith quantum. 

(a) Letting x = ; x^^xtx^, we minimize the mean square error in 

that interval. 

(b) Letting x * y^; x i _^<.x^x^, we minimize the peak error in the i fc h 
interval . 

When the probability density function within an interval, p^(x) is 
uniform as shown in Figure 3, then p£(x) is constant during that interval 
and the mean as given by (1) is equal to the midpoint as given by (3) . 

This implies that either type of identification of the interval r^ will 
result in identical optimization. 

The special case of uniform quantization has been carried out in 
Appendix A with the following results: 

The probability density function of the error generated by replacing 
the variable in the interval (x^ x i+ ^) by its mean or midpoint is uniform 
with 

p(e) = - for -q/2 < x < q/2 

q 

■ 0 otherwise 


resulting in zero mean error, q/2 peak error and e^ = e-^ « q^/12 

independently of the overall probability density function of the random 


variable x. 
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III. INFORMATION LOSS DUE TO QUANTIZATION 

The information conveyed by a message is the amount of new knowledge 
acquired by receiving the message. For example, if we knew the contents of 
the message before reception, its reception would not convey any information. 

The measure of information in the binary system could be defined as 
the minimum number of yes and no answers necessary to identify one out of 
n source symbols*, and the units are bits (for binary digits). Thus, the 
self-inf crmation of a discrete signal is 


H(x) 



(4) 


and it becomes maximum when all p( x j) are equal***, in this case: 


H(x) - -log p(x.) ^ P(x.) = -log p(x ) (5) 

For the continuous case, the situation is somewhat similar with p(x) being 
a uniform distribution and p(xj) substituted by P(x = X). Obviously, the 
latter expression is a constant for all x and approaches zero. Application 
of (5) for this case yields: 

H(x) ’ 106 L - i XV -) <6) 


*An equivalent definition is the number of bits necessary to specify any 
number less than or equal to n in binary form, 

**Log x = log 2 x unless otherwise specified. 

***F ano . (1) 
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This expression goes to infinity as P(x « X) goes to zero. The result is 
very logical and it means that we need an infinite number of digits to 
represent the value of an analog variable. The usual practice is to give 
the value of the variable to a certain decimal point, a process equivalent 
to assigning the values of the variable in n ranges and specifying the range 
in which the value lies. This process is called quantization. 

The self information of a quantized signal is: 


- £ pfrj.tcxoj) x°g P(>j i L <x<Xj) <7) 

The minimum self- informat ion occurs when P(Xj_]Ot*Xj) is constant for all j, 
and in this case: 


P(*i< x < x i+l> 



1 

n 


and 


H(x) « log n 


n is the number of quanta and is finite, resulting in a finite H(x) . 

We have seen in the last paragraph how the information of a continuous 
variable is reduced by the quantization process from an infinite to a finite 
value. The information loss seems to be infinite irrespective of the value 
of n, a finite number; however, if we re-examine our discussion, we shall 
discover that in real life the measurement of a variable cannot possibly 
contain infinite information due to many limitations, two of the most 
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important being the accuracy of the measuring apparatus and the system* 
noise. In general, the system noise is the main factor in determining the 
number of distinguishable levels of an analog value. For example, if the 
average signal power is S and the average noise (gaussian) power is N, the 
number of distinguishable signal levels is / and if the zero value 


is added the number of distinguishable voltage levels becomes 
Applying equation (6) , the information becomes 



1 


1 . . S+l. 

H(x) = 2 lo 8 ( — ) bits 


Although this is an unconventional method of deriving the information for a 
given S/N the answer is correct. 

If the signal has a bandwidth W and a duration T, invoking the sampling 
theorem, the signal may be (theoretically) described by samples spaced 
1/2W seconds apart; thus, the number of samples in an interval T will be 
equal to 2WT. The resulting maximum information per interval T is; 

2WT 1/2 log (S/N + 1)** 

and the maximum information rate (or channel capacity) is; 

W log (S/N + 1) 

The obvious deduction from the above formula is that there is no 
signal that contains infinite information unless the noise is zero or S/N 

*The word system may refer to anything from an amplifier to a transmitter- 
channel-receiver configuration. 

**When S/N = 1 — WT the dimension of the signal space. 
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is infinite, an impossible event in physical systems; consequently, the 
loss of information due to quantization is finite and may be reduced by 
increasing the number of quanta (or levels) . An increase in the number 
of levels will decrease the quantization error at the transmitter, but will 
increase the probability of error at the receiver, because the signal 
corresponding to one level (range/n)2 decreases as n increases, thus 
decreasing the received S/N. 

Referring to Figure 1, the quantization mean square error is an error 
that occurs in the transition x to and is given by: 



The error at the receiver due to channel noise is an error due to the 
transition from x^ to y^ (i?*j), and it is expressed in a statistical manner, 
because in quantized signal transmission an error will be effective only 
if it causes the signal to change level. Consequently, for N gaussian, no 
matter how small N is in comparison to R/n, the fact that N can assume 
values of -CP to oo imposes a probability that the signal will change level. 
For quantized signals with n levels of unequal length (nonuniform) the 
error produced by going from level i to level j is e^ associated with a 


*Uniform quantization is assumed. 
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probability P^j that depends on the distance between levels i and j and 
the type of modulation. The mean square error is then: 


•/■IE •!, <u 

i j 

Solving for for the typical case of PCM (uniform quantization into 2^ 

levels and binary signals), P^j becomes a constant (P) and e^j varies 
uniformly over all discrete distances which are q multiplied by powers of 


two; these distances are: 


q, 2q, 2 2 q, — , 2*“^; (q - R^i ) 


and (11) becomes 


k-1 „ 2 91- 

=»- n * 


In general, the two most significant errors, e^ and e^ are independent; 
thus the total error is given by (12) as 

7*= 7" + 7T d2) 

q N 


where 


n fx i 


(x - mi) Pi (x)dx 


i=l J Xi_i 


and e M is given by (11) 
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A1 though e z q is independent of p(x) for the case of uniform quantization, 

generally, for optimum quantization*, e 2 ^ is a function of p(x); from (11) 

it is obvious that e^ N is a function of e^ and P^ which are in turn 

functions of R, n, S/N, the type of noise, the type of modulation, and the 

type of detection.** Optimum quantization will involve optimization of n 

and q^ under the criterion of minimum mean square error as given by (12) . 

Minimization of (12) will invariably result in an equation that could only 

be solved by numerical methods. To simplify the problem, let us examine e„ 

N 

and eq separately. 

First it should be observed that e N and e have no minimum as a function 

h q 

of n all other conditions being constant. However, they are both monotonic 
functions of n, one increasing and the other decreasing. The opposing 
effects of n on e^ and e^ suggest optimum operation when the two errors 
become equal as expressed by equation 14. 


2 2 
e q e N 


(14) 


o 

Once n is thus chosen, e is minimized by using optimum quantization 
with respect to the intervals q^ as shown in section IV; with the new value 
of e a new n is chosen and the process is repeated. With a small amount 
of experience one might obtain a good estimate of e 2 ^, which may be 20-30% 
less than that due to uniform quantization, calculate n and then optimize for 
q^ in only one trial. 


*This will be proven in IV. 

**For example: 

Pi j for FSK = P * from Lawton ( 2 ) . 

Pij for PCM antipodal signals is an error function. 
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IV. OPTIMUM QUANTIZATION 

It has been shown in part II that under uniform quantization the results 
are independent of the overall probability density function of the random 
variable x. It will be shown here that the quantization error may be 
minimized if p(x) is utilized in determining the values of the quanta q^. 

The first type of optimization will be carried out under the condition 
that the quantization process maps all x in the interval (x^ x^) onto the 
mean m. or x = m^ for x^ ^ <x< Xi . The second type of optimization will be 
carried out under the condition that the quantization process maps all x in 
the interval (x^p x i ) onto the midpoint y^, and in the third type of 
optimization the approximation p^(x) = p^(x) will make m^ = y^ thus forcing 
the above two conditions to coincide. 

1. Optimum Quantization with (x^ x^) — iik 

To obtain the optimum quantization for a given number of quanta, n, 
and under the condition of mapping the i^ interval (x^ x^) onto m^, we 

must minimize the average mean square error as given by (B-l) . This is done 
in Appendix B and the results are given by (B-2) . 


®i + m i+l 
x i “ 2 


(B-2) 


if the range of x extends from a to b (B-2) represents n-1 equations with 
x Q = a and x n = b. 
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2. Optimum Quantization with xj.) yi 

In this case, we are actually defining optimum quantization as the one 
that minimizes the average peak error. This is carried out in Appendix C 
with the resultant n-1 equations for xi given by (C-3) 


x i+l - 2xf + x ul = 


Ai - Ai+i 

P ( x i) 


(C-3) 


or 


qi - <ii+i 


= Ai+1 - Ai 
P( x i) 


3. Optimum Quantization with pi(x) ”= p£ (X) 

If Pi(x) is approximated by p i (x), a uniform distribution for each 
interval both Pi(x) and m£ are functions of X£ and vary in such a manner 
so that the area in a quantum is preserved. Obviously this type of approxi- 
mation will make mi = yi = _i__ — LJl and we do not know the points of 
discontinuities until the error is minimized. 

From Appendix D the equations relating the points x^, x 2 x n-l are 

from (D-6) 

( x i - x i-l) 2 Up(yi) +p(xi)] = (xi+i - xi) 2 [2p(y i+ i) + p(xi)] (D-6) 

where 


P( x i) = P( x ■ x i) 

Another way to express this equation is: 

2q. Ai = 2q i+1 A i+1 + p( Xi ) (qi+q i+1 ) (q^-q^ (D _ 6) 

Since qi+i - qi may be small, the effect of the p(xi) term on the equation 
is very small. So as a preliminary estimate on Xi for the solution of (D-6) 
one may solve 




q i A i “ qi+1 A i+1 


(15) 



- 14 - 


DISCUSSION : 

It has been shown here that the type of quantization resulting in the 
highest error is the most common one; i.e., the uniform type. The use of 
the probability density function of the variable in choosing the quantizing 
levels reduces the quantization error. This error reduction increases as the 
"non-uniformity" of the probability density function of x increases. 

Extending the above statement the error reduction becomes zero at one 
extreme when the p.d.f. of x is uniform. 

The term "non-uniformity" implies the difference in p.d.f. from one 
level to the next. Thus, an extremely non-uniform p.d.f. for a given number 
of levels may become more uniform as the number of levels is increased, thus 
decreasing the effectiveness of the methods discussed in this paper. On the 
other hand, the self information becomes maximum when each symbol or 
quantization interval is equiprobable which implies uniform distribution. 
Intuitively speaking, it seems that the loss of self information due to non- 
uniformity, is compensated by the error reduction due to advantageous 
optimum quantization. 

Table I presents some results of improvement in quantization error by 
the use of optimum quantization. 

Inspection of the exact and approximate distribution method results will 


show that for all practical purposes the approximation is reasonably valid 
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APPENDIX A 


UNIFORM QUANTIZATION 

This type of quantization is common because of its relative simplicity 

of implementation. If the interval is represented by the mean, the quantization 

process will result in an average mean square error as given by (A-l) 

_ _ "* x^ 

e = 2^ (x-m-j^ p(x)dx (A-l) 

1 J Xi_! 

where m^ is given by (1) 

To prove this, we must first find the mean square error in each interval. 




~~1 

e,* 


ox-i 


2 1 
(x-mi) pi(x)dx = 


x i-l 


(x-m^) p(x)dx 


(A- 2) 


Ok 


i-1 


where 


Pi( x ) = ^ [u(x-x i _ 1 ) - u(x- Xi >] 


(A- 3) 


and u is the unit step function; A^, the area under p(x) in the ith interval, 
is the normalization factor for p^(x). Averaging over all intervals, one 
obtains the average mean square error 


> 2 = Z e- 2 P (xfir^ =^ e i 2 A i * 


(A-4) 


Next, substituting (A-2) into (A-4) we obtain (A-l) QED. 

A much simpler equation for the mean square error may be obtained if 
p (x) is approximated by a constant density function in the ith interval 
given by: 


i(x) = 


{ 1 P 

_ Jxi-l 


(x)dx 


x i - x^j. 


(A-5) 


P (x € r^ reads: the probability that x lies in the ith range; 

P (x £ rj;) = P (x i _ 1 < x < x L ) 
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This approximation is illustrated in Figure A-l. 

The error probability density function turns out to be uniform as shown 
in Figure A-2 and the average mean square error is q^/12 independently of the 
probability density function of x. Referring to Figure A-l the smooth line of 
p(x). The p.d.f. in each interval p^(x) is approximated by its average in that 


interval. 


PjTxX = [uCx-Xi.!) - u(x - x.)] 

x i - x i-l 


and the new piecewise uniform function is the new approximate p.d.f., w(x) . 


w(x) = \ p i (x) = 


This approximation brings the mean and the midpoint of each interval to the 


same point 


x i + x i-l 

m i = n 2 


So far we have taken a range of values of x (the infinite number of 
points between x^ and x^_^) and have identified them by their mean or midpoint 
mi or y^ respectively. The error due to this quantization is: 

e = x-y^ or x = e + y^ (A-l 

For y^ and e independent: 

»x - % M e * < A -' 


* M is the moment generating function of the random variable, 



I 
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Since the moment generating function is the Fourier transform of the p.d.f. 
(A-9) may be rewritten as; 

(A- 10) 

Equation (A-9) implies that 

P(x) = p(y t ) 0 p(e) (A-ll) 

If p(x) is approximated by w(x), the piecewise uniform curve, (A-ll) may be 
rewritten as: 



w(x) = p(yi) 9 p (e) (A- 12) 

At this point, it should be noticed that p(y^) is a train of delta functions 
centered at x s y^ and of area A^. If the convolution of p(e) and a train of 
delta functions p(y^) is to give the function w(x) of Figure A-l, it is clear 
that p(e) must be a rectangular pulse function as shown in Figure A-2. 

Normalization of p(e) results in K = 1/q. The mean is equal to the 
midpoint (uniform distribution) which is obviously zero. So the mean error 
is zero from 

_ r q, \ 

ede « 0 


r q/2 

51 ' Ln * 


and the mean square error per interval is: 
n 


-t - 51 e2 k de - q 2 / 12 


(A- 13) 


Averaging this error over all the intervals 
n 


e 7 = 5 ^ P(Yi) = e i 2 51 P(y i ) = " q2/ l 2 


(A- 14) 


(1) $ is the symbol indicating convolution. 
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APPENDIX B 


OPTIMUM QUANTIZATION WITH (xi_ 1} x £ ) 

Although calculus of variations could be used to minimize the error, 
the procedure to be followed here will be a simple one of taking the partial 
derivative of the error with respect to each variable at a time, holding 
the remaining variables constant. For n quanta there are n-1 variables 
and the above process will yield n-1 equations with n-1 unknowns, when the 
partial derivatives are set equal to zero. 

If the range of x extends from a to b and the number of quanta is n, 
the expression for the average mean square error is: 


— 

,2 


I 


x 2 


2 f 2 

e“ = | (x-m^) p(x)dx + j (x-m 2 )^ p(x)dx + 

a Jxi 


( 1 

yxi-i 




i) POOdx + 


J 


(x-n^) p(x)dx 


(B-l) 


*n-l 


Differentiating with respect to x^ 


1 .<J1> - 0 + 0 + 

"b x i 


If** 2 f Xi+1 

J (x^)^ p(x)dx +| (x- 

** J*i.i k 


(x-m i+ ^) p (x) dx+040- -+0 


2 2 
= (X t - mi) p(xi) - (x £ - m i+1 ) p(xi) 

Setting the above equation equal to zero for all i 

2 o 

(x t - mp = (Xi - m i+1 ) z if p(xi> £ 0 


The above equation yields 

... = *»i + m i+l 

Ai ■ 


(B-2) 
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APPENDIX C 


OPTIMUM QUANTIZATION WITH (x^, x t ) y ± 

For the conditions imposed here we must minimize the average peak error. 

The peak error e is 
P 

e p = Xi = q i/2 (C-l) 


and the average peak error is 


e 


P 



P(xeqi) 



(C-2) 


By differentiating (C-2) with respect to x^ and by setting equal to zero we 
obtain the condition of optimum quantization for peak error which is 
given by C-3. 


Aj[+1 _ Ai 

2 x 1 - x i+1 - xj.! - p ( Xl ) 


(C-3) 


Equation (C-3) represents n-1 equations 
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APPENDIX D 

OPTIMUM QUANTIZATION USING THE APPROXIMATE pdf 


The approximation given by p^(x) = p^xj * will change the dotted line 
pdf of Figure B-l to the solid line pdf. In addition, the mean m^ equals the 
midpoint which is equal to one-half of the sum of the limit points of the 
interval. 

The method of optimization will be similar to the one employed in 
Appendix B with differentials replaced by differences because of the nature 
of p^(x) . The error is given by: 

e 2 = <"ej 2 > P(x£ r j) = 21 

j i 


f 


(x-mj) 

A interval 


Pj(x) 


dx 


-f 

•J v 


i 


(x-m^) p^(x)dx +1 (x-m2) P2( x ) dx + 


Jx ±-i 


(x- mi ) p ± (x) dxJ 


(D-l) 


A x i+1 

{ ( x " m i 

-'x. 


+1> P i+ l< x ) 


dx + 4- 


(x-n^) P n (x) dx 


c n-l 


If x^ is allowed to vary by a small amount Ax while the rest of the limits 

T 1 

are kept constant, the new ms error e^ is given by (D-l) with the following 
changes in the ith and i + 1st integrals. The limit x^ is replaced by 
X£ + Ax, 


______ 1 1 1 1 

Pi(x) Pi(x), Pi+l< x > -^P i+1 ( x ) > m i ”^ m i » and m i+l ~^ m i+l 

— T 

The variation of the ms error is given by the difference of e^ and e ^ 


* See (A-5) and (A-6) for definition. 





£(e z ) = e z - - I (x-n^ ) p ± (x) dx +1 (x-mj- ) P i+ 1 (x) 


v i+l' 

i+Zlx 


2 2 

(x-m i ) p ± (x) dx - (x-m i+1 ) P i+1 < x ) dx 


Using the fact that all pdf's in (D-2) are uniform and m is half of the sum 

x i-l + x i +Ax xi + x i+1 

of the limits, i.e., m^_ = — > , tn^+i “ 2 — ,fc " c * 

(D-2) may be rewritten as*: 


i 1 (x i 


+ Ax - X^) 3 - PjL (x) ( Xi - x ± _i ) 3 + P i+1 ( x ) ( X i+ 1 - X i“ Ax ) 


- p, +1 ( x ) ( x i+l - x i 


To simplify (D-3) let us refer to Figure D-2 and consider the integral that 
represents the area under p(x) in the intervals adjoining x^ + 4.x 


rH+A x a 

J (p(x)dx = j 

J x i_l J 


(p(x)dx = 1 p (x) dx +1 p(x) dx 


i+^kx 


similarly 


p (x) dx = p (x) dx 

C i+A x J x i 


X i+Ax 


p (x) dx 


>x i+/lx 

Substituting (A-5) into (D-4) and (D-5) and letting p(x)dx = A A 

J Xi 

we get; 

1 

(x t +Ax - x i _ 1 ) p i (x) = (Xi - x i ;L ) P i (x) + 4 A 


( x i+l - x i - Ax) Pi+1 (x) - ( x i+l~ x.) Pi4l (x) - Aa 


*if m ■ a 


(x-m)^dx 





- 3D - 


Substituting (D-4) and (D-5) into (D-3) and expanding 

A e 7 = \ 2 £<Xi - x^) Pi (x) ^ (x ± - x i _ 1 ) dx + (&x) 2 J 

+ (x i+1 - X t ) P i+1 (x) /"-=? < x i+i • x i> 6x + <* x >7 


+ A A (Xi - Xi .!) 2 - (X i+1 - Xi ) 2 +<^(x i+1 - Xi _ x ) 


dx 



when o A A — ^ p(x^)4x 

and: 


^x-)0^x 12 ^ ^ x i “ x i-l^ Pi^ x ) ( x i+l “ x i) Pi+l^ x ) + 

P(x.) f (xl - Xi - l>2 - (xi+1 • x ° 2 ]] 
setting the derivative equal to zero and replacing Xj - Xj_^ by qj 

we obtain the relation for optimum quantization 


^ q ± Pi (x) - 4 q i+ l 2 Pi+l(x) + p(Xi) (q i+1 2 - q t 2 ) 


(D-6) 


Repeating this for all i is equivalent to considering (D-6) as n-1 equations. 
These n-1 equations together with 
n 



x n " x o 


i=l 


form the n equations with n unknowns 



GLOSSARY 


A continuous random variable (r.v.) 


A i 

y± 

m. 


The limits of the quantizing intervals. 

_ x i + x i-l 


The midpoint of the ith interval (y^ = 

►x 

( 

The mean of the ith interval (m. 


) 


^ x i 


, x. 


If 1 

x p(x)dx/ | p(x)dx ) 

x i-i ' J xi_i 


r^ The ith range of x (x^ -1< x < x^) 

R The range of x (also the value of the range s x n - x Q ) 

n The number of quantization levels. 

q^ The value of the ith quantization interval (q^ = x^ - x^_^) 
p(x) The probability density function (pdf) of x 


p.(x) The normalized pdf of x in the ith interval (p^x) = Pfo l ; x i _ 1 <’x<x i ) 
1 A i 

p(xi) = p(x=x i ) 

P(y i ) The probability that x is represented by y^ an impulse function located 
at x = y± with weight A^ = P (x^_^^x<x^) = P(xtfr^) 


p^(x) = the mean pdf in the ith interval 



S The average signal power 
N The average thermal noise power 


W The signal bandwidth 
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The pdf of the uniform quantization error. 


Figure A- 2 



Figure D-2 
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